Optimal control of a leaking qubit 
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Physical implementations of quantum bits can contain coherent transitions to energetically close non-qubit 
states. In particular, for anharmonic oscillator systems such as the superconducting phase qubit and the transmon 
a two-level approximation is insufficient. We apply optimal control theory to the envelope of a resonant Rabi 
pulse in a qubit in the presence of a single, weakly off-resonant leakage level. The gate error of a spin flip 
operation reduces by orders of magnitude compared to simple pulse shapes. Near-perfect gates can be achieved 
for any pulse duration longer than an intrinsic limit given by the nonlinearity. The pulses can be understood as 
composite sequences that refocus the leakage transition. We also discuss ways to improve the pulse shapes. 
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An ideal Hilbert space for a qubit has two dimensions, 
spanned by the states |0) and |1). However, in physical imple- 
mentations quantum evolution can lead to transitions to non- 
qubit levels. In most cases the levels are energetically far away 
and hence are not the dominating limitation for quantum oper- 
ations, for instance in the case of orbital degrees of freedom in 
nuclear or electronic spin-1 /2 qubits [ 1 1. In other cases such 
as in superconducting qubits [2| and optical lattices the 
situation is less favorable. In superconducting charge qubits 
the tunneling of more than one excess Cooper-pair on the su- 
perconducting island still has a sizable energy penalty |4j. In 
phase qubits J5]|6l |7), optical lattices, and the transmon 019) 
one has a third level which is only slightly detuned from the 
qubit energy splitting. These anharmonic oscillator qubits are 
the motivation for the present paper. Control strategies are 
required that go beyond the simplified two-level approxima- 
tion. Initial phase qubit experiments [5] used weak and thus 
slow Rabi pulses for qubit manipulations, making poor use 
of the available coherence time. Newer experiments Q com- 
bine Gaussian pulses with engineered spectrum and limited 
bandwidth. Initial proposals for avoiding leakage in super- 
conducting qubits based on renormalization do not apply to 
phase qubits 1 10 1 or lead to complex sequences of hard pulses 
HEQ- 

Theoretical optimal control approaches are frequently used 
in quantum computing to synthesize quantum gates lfl2l [131 
IT4l . The models mostly assume coherent evolution of cou- 
pled two-level systems such as nuclear spins lfT31l or super- 
conducting qubits |[T6l [P71 . Progress also has been made in 
optimally controlling systems in the presence of decoherence 
mechanisms, either in Markovian |[T8l [T9l or non-Markovian 
||20l |2J I regimes, as well as an inhomogeneity 11221 [23]. In 
this paper, we study a qubit in the presence of coherent tran- 
sitions to a weakly off -resonant non-qubit level. We look for 
optimal pulses that generate quantum gates in the qubit sub- 
space, assuming that a single control for the envelope of a 
resonant pulse is available. The pulse shapes significantly 
improve the fidelity obtained by refined standard techniques 



l24l . We identify a time limit related to the nonlinearity above 
which efficient high fidelity pulses are possible. 

Model — Our Hamiltonian of a qubit in the presence of a 
single leakage level is given by: 

H{t) = ea z +S(t)a x +E h \L)(L\+V25(t)(\l)(L\+h.c). (1) 

Here, e is the qubit level splitting while 5(t) is a time depen- 
dent control field. The Pauli matrices for the qubit are given 
by a z = 1 1 > < 1 1 - |0)(0| andc^ = |1)(0| + |0)(1|. Non-zero 
controls generate transitions not only in the qubit subspace 
but also to the leakage level \L) with energy E^. Hence, con- 
ventional control techniques can reduce the quality of opera- 
tions in the qubit subspace. This Hamiltonian approximates 
the three lowest energy states of a weakly nonlinear oscilla- 
tor system, such as a Josephson phase qubit or a transmon 
E4l |25l . The matrix element of the transition 1 1 ) — > | L) is 
scaled by \/2. The detuning of the leakage level is the dif- 
ference between the qubit splitting and the splitting of the 
transition |1) — > |L), i.e. Alu = 3e — E^. Matrix elements 
between |0) and \L) are negligible following the parity selec- 
tion rule of a nonlinear oscillator qubit at weak to intermediate 
detuning. For resonant driving on the qubit energy splitting, 
5(t) = X(t) cos(cji) with uj = 2e, one finds the Hamiltonian 
in the rotating wave approximation (RWA), 

H R (t) = -Acj\L) R (L\ R +X(t)a R +V2X(t)(\l) R (L\ R +h.c.). 

(2) 

A superscript R denotes states and operators in the rotating 
frame, while \{t) is the envelope of the resonant pulse and 
can be viewed as a modulated Rabi frequency. The RWA rep- 
resentation assumes first that the logical qubits are encoded in 
the rotating frame; we drop the superscript R for notational 
clarity. Second, it is assumed that the Rabi frequency \{t) is 
much smaller than e. This assumption is validated by results 
of this paper that show, that the Rabi frequency is ideally com- 
parable with Aui. In the following, we will naturally focus on 
the qubit flip operation (NOT gate) given by, 

U F = e^ (e^\L)(L\ + a x ). (3) 
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The global phase and the relative phase </>i and the phase of 
the leakage level <j) 2 are meaningless for the NOT gate and 
thus taken to be arbitrary. First, we discuss controllability in 
the limits of weak (A <C Aw) and strong (A 3> Aw) driv- 
ing: for weak driving it is possible to make the population 
of the leakage level arbitrarily small by choosing the A small 
enough. The downside of this method is that the pulse has 
to be very long, therefore gate fidelity is limited by the co- 
herence time. In the limit of strong driving, one in princi- 
ple could make the pulses arbitrarily short and apply many of 
them within the coherence time. However, the strong driv- 
ing Hamiltonian, in which Aw is the smallest frequency, is 
similar to that of a single resonantly driven harmonic oscilla- 
tor, i.e. H(t) w X(t)a x + V2\(t)(\l)(L\ + \L)(1\). Hence, 
no high-amplitude control field creates a perfect NOT in the 
qubit subspace. 

Approximate solution — One can find an approximate solu- 
tion for our problem in the weak driving limit, A/ Aw <C 1, 
that is exact to first order in A/ Aw E4ll . We denote by W(t) a 
free evolution (A = 0) of time t and by R(0) a weakly driven 
evolution, such that 6 = J* \(t')dt' with \/Auj < 1. Then 
the solution is given by 

U F ~ R(6i)W (^) R(6 2 )W (^) R(0x). (4) 

This is a cascade of three pulses interrupted by two free evo- 
lutions of length tt/Aui. Note that the free evolution for a 
time t = 7r/Aw leads to an identity operation in the qubit 
subspace and a phase shift of it on the leakage transition, i.e. 
1 0/1) -> 1 0/1) and | L) -> -\L). Thus, in the isolated qubit 
subspace, we have just the three rotations with the condition 
26»i + 6» 2 = tt/2 (e.g. 0i = vr/8 and 9 2 = tt/4) for a NOT 
gate. The dynamics on the leakage transition can be identi- 
fied with time-dependent perturbation theory after diagonal- 
izing the qubit subspace in ([T]i to lift the degeneracy. This 
pulse sequence removes transitions to the third level to first 
order in A/Aw, with errors of the order (A/Aw) 2 remaining. 
As a comparison, the rotation with only one weak pulse dis- 
cussed in the previous paragraph introduces errors of the or- 
der A/ Aw. In principle, recursive application of such pulse 
sequences could remove the error up to any desired order, but 
would lead to a complicated and long pulse. Also, it needs 
to be pointed out that the rotations themselves require small 
A/ Aw and thus inevitably take significant extra time beyond 
the waiting periods. In this work, we find optimal sequences 
with respect to fidelity and pulse duration. We resort to numer- 
ical methods of optimal control, namely the Gradient Ascent 
Pulse Engineering (GRAPE) algorithm [12|. 

Control theory — Given a Hamiltonian H(t) = H(X(t)) 
such as Eq. Q, the goal is to find a function for the con- 
trol parameter A(t), t <E [0,i 9 ], such that a desired uni- 
tary quantum gate Up is generated. Formally, this can be 
achieved by minimizing the Euclidean distance between tar- 
get and actual evolution, i.e. \\Uf — U(t g )\\ 2 = II^f||| + 
||[/(t s )|||-2Retr (ulU(t g )j. Here, U(t) is the usual time 
evolution operator obeying the Schrodinger equation U (t) = 



-jrH(t)U(t) with initial condition U(0) = 1. Minimizing 
the Euclidean distance is, up to a global phase, equivalent to 
maximizing the fidelity fa = ±\tT(U F U(t g ))\ 2 . The fidelity 
fa is not sensitive to the global phase ip^, as required above. 
Additionally, we want to be insensitive to the relative phase 
of the leakage level. Averaging over the free phase <p 2 and 
keeping only the relevant terms leads to, 

<fe = \ (\(0\UlU(t g )\0) + (l\uilJ(t g )\l)\ 2 ) . (5) 

In other words, it is sufficient to consider only the qubit sub- 
space when evaluating the gate performance — everything else 
is fixed by unitarity of U(t g ): maximizing fa automatically 
eliminates transitions to the third level. Optimization of fi- 
delity <fi 2 requires the calculation of its gradient with respect 
to the controls. To this end, we introduce the approximate time 
evolution U(t g ) w UnUn-i—U\. The time interval [0,t g ] is 
sliced into N parts of length At, on each of which the controls 
and therefore the Hamiltonian is assumed to be constant. The 
propagator for an individual time step Uj (j = 1...N) can 
thus be written as Uj = exp (— j^AtH(Xj)), where A.,- is the 
control amplitude during the jth time slice. Along the lines of 
lfT2ll . the gradient of the fidelity ^ with respect to Xj is given 
by, 

J lk=0,l j 

]T (m\ulU(t g )\m)\. (6) 

771=0,1 J 

This gradient is used in the GRAPE algorithm to find the max- 
imum of the fidelity Eq. pi as a function of the control param- 
eters Xj . Note that Eq. d6]l is valid when the time slices At are 
small compared to the characteristic time scales of the system. 

Pulses and performance — The initial guess for the opti- 
mization is the 7r/2-pulse one would use in a two-level system, 
i.e. A = 7r/ (2t g ) for all t < t g . This pulse is then optimized 
using GRAPE based on the fidelity <f> 2 . For now, we assume 
that the controls X(U) can take arbitrary values and that they 
can change arbitrary quickly from one time slice to the other. 
We assume further that we can permit arbitrary excursions to 
\L) during the pulse. As a result, at time 27r/Aw we recover a 
pulse similar to the approximate analytical solution, see Fig.[T] 
(a). GRAPE finds a symmetric sequence of three soft yet high 
amplitude, approximately Gaussian pulses interrupted by two 
periods of free evolution. The areas under the three single 
pulse elements approximately correspond to the angles dis- 
cussed earlier. Deviations are compensated by the negative 
amplitude during the free evolution parts. Fig. [T] (b) shows 
the population of the qubit and the leakage level for the initial 
state being |0). The first pulse of the cascade transfers about 
20% population to the excited state |1) while the leakage level 
remains almost unpopulated. After the first wait period, the 
second pulse populates the leakage level around 40%, where 
it remains during the second wait period. Here, the leakage 
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FIG. 1: Control fields for a high-fidelity spin flip gate for a qubit in 
the presence of coherent transitions to a non-qubit level. The control 
field with the duration t apt = 2n/Acu, pictured in (a), is optimal in 
the sense of a short gate time and high fidelity of 1 — 02 < 10 -4 . A 
cascade of three pulses is found that harnesses the intrinsic resource 
of the system. In panel (b) the population of the three levels during 
the application of that pulse is shown; the leakage level is populated 
during the pulse and completely emptied in the end. In (c) and (d) 
a shorter (t g — 4.5/ Alj) and longer (t g — 7.0/ Aw) pulse is de- 
picted. These control fields are optimized without constraints to the 
pulse shape. Panel (e) demonstrates a control field at t g — 10.0/ Aw 
with a smooth pulse rise, obtained with a penalty function method. 
Nevertheless, a fidelity of 1 — 02 < 10~ 8 is achieved. 



level accumulates a relative phase such that the third pulse 
leads to complete depopulation. For times below i opt , pulses 
such as in Fig. [T] (c) are obtained. The pulse optimization 
tries to improve fidelities by rapidly turning the control field 
to very high amplitudes. However, the integral resource of 
the 2tt/Auj waiting time is not available, which lowers the at- 
tainable fidelities. For longer gate times than t opt = 2tt/ Aw 
the optimal control field is a smooth pulse shape, see Fig. [T] 
(d). As an additional benefit, the control amplitudes are lower, 
leading to less transition to the non-qubit level during the ap- 
plication of the pulse. 

Fig.[2]shows the gate error 1 — 02 versus pulse duration t g 
for unoptimized and optimized pulses. We see that GRAPE 
pulses easily achieve errors of 1 — 2 = 10~ 6 and below. It 
has been estimated by various authors assuming different error 
models that the threshold error rate for fault-tolerant quantum 
computing lies between 1CT 2 and 10" 6 0]|26l|27]|28]]. Within 
the present model, pulse shaping easily reaches these thresh- 
olds for gate durations greater t opt . Optimizing fidelity 2 is 
advantageous over optimizing fidelity 0i : the irrelevant rela- 
tive phase of the leakage level is not taken care of and there- 
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FIG. 2: The attainable gate error of a spin flip gate using various 
control strategies is demonstrated as a function of pulse duration. 
Rectangular (• • •) and Gaussian pulses with a = 2 (— •) and a = 3 
( x ) only achieve limited fidelities at short pulse durations. GRAPE 
optimized control fields (— ) consistently improve the gate error, with 
1 — 02 < 10 -8 after an optimal gate time of t opt = 2-k/Alj. Pulses 
that have a smooth initial rise slightly increase the gate error and 

shift the optimal gate time ( ). The pulse rise times are around 

1.0/ Aw, which is obtained by choosing the penalty function <JsJ with 
t = 0.1/Awand7 = 5.0/ Acs. 



fore higher gate fidelities can be obtained. For comparison, we 
also show the gate error of standard pulse shapes like Gaussian 
and rectangular pulses ll24ll . Gaussian pulses used here are 
given by X(t) = a/t g ^/^/2 exp(-a 2 /t 2 g (t - t g /2) 2 ). These 
pulse shapes have attainable gate errors of 10 _1 — 1CP 2 at the 
pulse durations considered here, orders of magnitudes worse 
than the optimized pulses. For rectangular pulses, only at gate 
times of t g > 280/Aw errors below 10~ 4 can be achieved. 
Essentially, these long gate times mean low control ampli- 
tudes and thus only small population of the leakage level: the 
weak-driving limit where A/ Aw <C 1. 

Improving the pulse shape — The pulses presented so far 
are obtained by solely optimizing the fidelity 02, Eq. (|5j. As 
seen in Fig.[T]the controls have sharp initial rises, which may 
pose problems in the experimental implementation. In this 
section, we show that controls with smooth rises can be ob- 
tained at a small cost of pulse duration. We use the concept of 
penalty functions to constrain the gradient search algorithm. 
High amplitudes at the beginning and the end of the pulse can 
be penalized by amending the fidelity Q, 



lA {t)X 2 {t)dt. 



(7) 



Here, we take the penalty strength as a function of time to be 
of the form 



7a(£) =7(2 — tanh 



tanh 



to 



(8) 



where the positive 7 is the overall strength of the penalty and 
to essentially parameterizes the rise time of the pulse. A non- 
zero jA(t)\ 2 (t) for any time t will reduce the fidelity. A 
smooth penalty like in Eq. ([8]) leads to smooth pulses shapes. 
The gradient of 02 is used in the optimization procedure. 
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Fig. [T] (e) shows the envelope of a pulse with t g — 
10.0/ Aw, obtained by optimizing the fidelity ^ and <JsJ with 
the parameters 7 = 5.0/Aw and to = 0.1/Aw. The con- 
trol field starts at zero and increases within a time of around 
0.5/Aw to the first peak of around — 0.1 Aw and within a time 
of around 1.8/Aw to the second peak of around 0.6Aw. This 
pulse has a gate error below 10~ 8 . In Fig. [2] the gate error of 
the amplitude-constrained pulses is demonstrated as a func- 
tion of the pulse time. The parameters are again 7 = 5.0 /Aw 
and to = 0.1/Aw. The introduction of a penalty for the con- 
trols comes at a small cost of fidelity. The optimal gate time 
t opt of the unconstrained case is shifted to around 7. 75/ Aw. 
After that gate time, errors of below 10~ 6 are obtained, due 
to the fact that the 2ir/Aui free evolution and the penalty re- 
quirements can be easily incorporated into a shaped control 
field. 

Discussion of the time scales — We discuss the control 
fields and their properties in terms of the actual potential an- 
harmonicity observed in the latest experiments in phase qubits 
and the transmon. In the phase qubit, the detuning is given in 
Fig. 5 of the supplementary material in [29] to be Aui/2-k = 
0.2 GHz. Thus, the optimal gate time is t opt = 5 ns. This 
compares favorably to the 8ns FWHM Gaussian pulse em- 
ployed in 11291 with experimental gate fidelity of 0.98. The 
amplitudes of the pulse sequence at t opt , Fig.[T](a), are around 
A/2tt = 0.8 GHz, while the FWHM of the three approxi- 
mately (half) Gaussian pulses is less that Ins. Other pulses, 
e.g. Fig. [T] (e) have a Rabi frequency and a modulation fre- 
quency of the order of the detuning. In the transmon, the de- 
tuning is slightly larger, Aui/2ir — 0.455 GHz [9|, leading to 
an optimal gate time of t opt = 2.2 ns. 

Conclusion — We have shown that high-fidelity quantum 
gates in a qubit can be performed despite the presence of a 
non-qubit leakage level. Our model approximates the reso- 
nantly driven Josephson phase qubit and the transmon, and 
is with modifications applicable to optical lattices. We have 
elucidated a composite sequence of pulses that performs a 
spin flip gate in the qubit subspace and refocusses the leakage 
transition to first order in the weak driving limit. Numerical 
optimization of the control field with the GRAPE algorithm 
drastically improves fidelities and pulse durations, leading to 
smooth, low-amplitude pulse shapes. We have identified an 
optimal pulse time t g > 2-k / Aw that is integral to the prob- 
lem and above which gate errors for a spin flip operation are 
below 1 — 4> 2 < 10~ 8 . As a comparison, the rectangular pulse 
would take t g w 280/Aw for a gate error of 10~ 4 . We have 
modified the pulse optimization with a penalty function such 
that the control fields become easier to realize in the exper- 
imental implementation. We have shown that this constraint 
can lead to similar near-perfect gate errors when the pulse du- 
ration is lengthened by about twice the required rise time. 

We would like to acknowledge useful discussions with 
A.G. Fowler, J. Gambetta, J.M. Martinis, R. McDermott, 
F. Motzoi, and T. Schulte-Herbriiggen. This work was sup- 
ported by NSERC through a discovery grant and Quantum- 
works. 



* Electronic address: pr@patrickre.com 
' Electronic address: fwilhelm@iqc.ca 
[1] M. Nielsen and I. L. Chuang, Quantum Computation and Quan- 
tum Information, Cambridge University Press, Cambridge, UK 
(2000). 

[2] J. Clarke and F.K. Wilhelm, Nature 453, 1031 (2008). 

[3] S. Maneshi, J. F. Kanem, C. Zhuang, M. Partlow, and A. M. 

Steinberg, Phys. Rev. A 77, 022303 (2008). 
[4] Y. Makhlin, G. Schon, and A. Shnirman, Rev. Mod. Phys. 73, 

357 (2001). 

[5] J. M. Martinis, S. Nam, J. Aumentado, and C. Urbina, Phys. 
Rev. Lett. 89, 117901 (2002). 

[6] M. Steffen, M. Ansmann, R. McDermott, N. Katz, R.C. Bial- 
czak, E. Lucero, M. Neeley, E. M. Weig, A. N. Cleland, and J. 
M. Martinis, Phys. Rev. Lett. 97, 050502 (2006). 

[7] E. Lucero, M. Hofheinz, M. Ansmann, R. C. Bialczak, N. Katz, 
M. Neeley, A. D. O'Connell, H. Wang, A. N. Cleland, and J. 
M. Martinis, Phys. Rev. Lett. 100, 247001 (2008). 

[8] J. Koch, T. M. Yu, J. Gambetta, A. A. Houck, D. I. Schus- 
ter, J. Majer, A. Blais, M. H. Devoret, S. M. Girvin, and R. 
J. Schoelkopf, Phys. Rev. A 76, 042319 (2007). 

[9] J. A. Schreier, A. A. Houck, J. Koch, D. I. Schuster, B. R. John- 
son, J. M. Chow, J. M. Gambetta, J. Majer, L. Frunzio, M. H. 
Devoret, S. M. Girvin, and R. J. Schoelkopf, Phys. Rev. B 77, 
R180502 (2008). 

[10] R. Fazio, G.M. Palma, and J. Siewert, Phys. Rev. Lett. 83, 5385 
(1999). 

[11] L. Tian and S. Lloyd, Phys. Rev. A 62, R050301 (2000). 

[12] N. Khaneja, T. Reiss, C. Kehlet, T. Schulte-Herbriiggen, and S. 

J. Glaser, Journal of Magnetic Resonance 172, 296 (2005). 
[13] LP Palao and R. Kosloff, Phys. Rev. Lett. 89, 188301 (2002). 
[14] V. Ramakrishna and H. Rabitz, Phys. Rev. A 54, 1715 (1996). 
[15] CA. Ryan, C. Negrevergne, M. Laforest, E. Knill, and R. 

Laflamme, arXiv:quant-ph/0803.1982. 
[16] S. Montangero, T. Calarco, and R. Fazio, Phys. Rev. Lett. 99, 

170501 (2007). 

[17] A. Sporl, T. Schulte-Herbriiggen, S. J. Glaser, V. Bergholm, M. 
J. Storcz, J. Ferber, and F. K. Wilhelm, Phys. Rev. A 75, 012302 
(2007). 

[18] H. Jirari and W. Potz, Phys. Rev. A 74, 022306 (2006). 

[19] T. Schulte-Herbrueggen, A. Spoerl, N. Khaneja, and S.J. 
Glaser, |arXiv:quant- ph/0609037j/ 1 . 

[20] P. Rebentrost, I. Serban, T. Schulte-Herbriiggen, and F. K. Wil- 
helm, arXiv:quant-ph/0612165vl. 

[21] G. Gordon, G. Kurizki, and DA. Lidar, Phys. Rev. Lett. 101, 
010403 (2008). 

[22] M. Mottonen, R. de Sousa, J. Zhang, and K. B. Whaley, Phys. 

Rev. A 73, 022332 (2006). 
[23] M. Steffen and R.H. Koch, Phys. Rev. A 75, 062326 (2007). 
[24] M. Steffen, J. M. Martinis, and I. L. Chuang, Phys. Rev. B 68, 

224518 (2003). 

[25] M. R. Geller, E. J. Pritchett, A. T. Sornborger, and F. K. Wil- 
helm, in Manipulating Quantum Coherence in Solid State Sys- 
tems, Springer, Netherlands, (2007). 
[26] E. Knill, [arXiv:quant-ph/0410"T99l 
[27] A. M. Steane, Phys. Rev. A 68, 042322 (20 03). 
[28] D. Aharonov and M. Ben Or, |arXiv:quant-ph /9906 1 29 
[29] E. Lucero, M. Hofheinz, M. Ansmann, R. C. Bialczak, N. Katz, 
M. Neeley, A. D. O'Connell, H. Wang, A. N. Cleland, and J. 
M. Martinis, arXiv:quant-ph/0802.0903vl. 



